I’m sure it happened to you or someone you know where you forgot where you put something. I remember my mother always saying: “Where did I put my glasses?” or “I forgot where I put my keys?“. Well, it happens to us all.
Now imagine a Mixed Reality app using the Magic Leap One with the upcoming object detection feature. I don’t know how the feature will work exactly, whether it can run continuously in the background or not, but let’s assume that yes it will.
So, the app, which I call “Where is it?” will continuously use object recognition to scan for different objects as you move around the house. These objects are scanned and saved to a local storage (or online) with coordinates of those objects locations.
Now, let’s assume that you forgot where you put the glasses. you can combine it with voice recognition and ask: “Where did I put my sunglasses?”, the system then will know how to query the database and bring up the list of objects and coordinates, then use visual AR guide to guide the user to the location.
Let’s assume that you put the key in the bag. It the app works in the background, it needs to be smart to remember “things that are put into things” and then remember where that other object that the searchable object is inside it, is located.
That can be a nice useful app, especially when we get to a time where you actually wear the glasses for a longer period of time. I don’t know if there is an option to run an app like a service in the background so it can support this functionality of mapping object and their location without actually having any UI visible or explicitly needing to run the app to start mapping.
Anyways, just an idea that came into my mind because I saw a need for it. It would be great seeing someone making such app. If you do use this idea, don’t forget to let me know about it, if you don’t mind, I want to see it in action. Thanks.
Update: regarding object recognition. Magic Leap suppose to add it pretty soon. However, I came across Selerio, that is specialized in 3D scene understanding, so you might use this solution with this app. Here take a look, tell me what you think.
I will add more solutions to help you build this app once I found ones. Cheers.